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Abstract - This paper is devoted to the study of large deviation be- 
haviors in the setting of the estimation of the regression function on 
functional data. A large deviation principle is stated for a process Zn, 
defined below, allowing to derive a pointwise large deviation principle for 
the Nadaraya- Watson-type /-indexed regression function estimator as a 
by-product. Moreover, a uniform over VC-classes Chernoff type large 
deviation result is stated for the deviation of the Z-indexed regression 
estimator. 
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1. INTRODUCTION 

The regression problem has received a great interest and has motivated a great 
number of investigations and studies throughout the time bringing to the statistic 
literature a considerable knowledge. A number of models and nonparametric esti- 
mators to estimate the regression function have been proposed in the literature when 
the discrete time or the continuous time explanatory random variables take their 
values in a finite dimensional space where the Lebesgue measure plays an impor- 
tant role. We refer to Bosq (1998) for an account of properties and results and the 
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references therein. Due to the availabihty of computing resources that allow sharp 
recordings in phenomena observation up to the level where data may be treated 
as curves, functional modeling has received a lot of attention in the last few years 
from mathematical, probabilistic, statistical or physicist points of view. It is worth 
noticing that there is an increasing number of sources of potential applications of 
functional models, as in chemiometrics, environmetrics, speech recognition, radar 
range profile studies, medical data and so on. The number of publications studying 
properties of these models, as asymptotic issues for example, grows continuously. 
For an overview of the present state of the art, we refer to the works of Gasser et al 
(1998), Bosq (2000), Ferraty and Vieu (2000, 2004), Ramsay and Silverman (2002, 
2005), Masry (2005), Ferraty et al (2007), Ezzahrioui et al (2008), and to the recent 
monograph by Ferraty and Vieu (2006) and the references therein. 

To introduce the study framework, let (Xj,y^)jgN be a sequence of i.i.d. pairs of 
random elements where Yi is a real-valued random variable with density g, with 
respect to the Lcbcsgue measure on M, and Xi takes its values in some semi-metric 
abstract space {S,d{-,-)). This covers the case of semi-normed spaces of possibly 
infinite dimension (e.g., Hilbert or Banach spaces) with the norm || ■ || and the 
distance d{x, y) = \\x — y\\. For a real function I and any fixed x & £, the Z-indexed 
regression function eit Xi — x is defined by r'(x) := E(Z(yi)|Xi = x). 

The Nadaraya- Watson type estimator of r' has been introduced by Ferraty and Vieu 
(2000). It is defined, for any fixed x E £,hy 

0, elsewhere. 

Here, i^T is a real- valued kernel function, h := hn is the bandwidth parameter (which 
goes to as n goes to infinity) , 

^m(-) = ;^)t = ^^± m^(-), (2) 

where 



h 

and is a positive function that will be defined below. Notice that the index function 
I allows to study simultaneously properties of several estimates. The first example 
is given by the most classical regression function estimator where I stands as the 
identity function. Whenever Z = 1^ is the indicator function of the set A, r^(x) is 
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the estimator of the conditional probabihty measure of the event {Yi e A} given 

For X & E, consider now the vector process 

Zn{x) = (r„,i(x),f„,2(2;)). 

In this paper, we aim at estabhshing a large deviation principle for the process Zn{x) 
and deriving asymptotics for the /-indexed regression function estimator in both the 
pointwise case and the uniform, over some vc-classes, case. 

There exists an extensive large deviation literature involving many areas of probabil- 
ity and statistics. We refer to the books of Dcmbo & Zeitouni (1998) and Deuschcl & 
Stroock (1989) and the references therein for an account of results and applications. 
In nonparametric function estimation setting, several results have been obtained 
these last years. We refer to Louani (1999) and Ould Maouloud (2008) where the 
studies involve the Nadaraya- Watson and histogram estimates of the regression func- 
tion respectively both in the real vector case. Using the delta- sequence estimation 
method, Louani and Ould Maouloud (2011) established a large deviation principle 
for the real regression function estimate embedded in the Li space equipped with 
the weak topology. Notice that the main applications of large deviation results are 
related to the efficiency of tests in the Bahadur sense, sec Nikitin (1995) for more 
details, together with the inaccuracy rate of estimators that allow to compare test- 
ing procedures and estimation performances respectively. The results may be also 
used to establish estimates consistency with rates of convergence. 

2. RESULTS 

Our results are stated under some assumptions we gather hereafter for easy reference 

(Al) K is a. nonnegative bounded differentiable kernel over its support [0, 1] and 
^(1) > 0. The derivative K' of K exists on the interval [0, 1]. 

(A2) For X E S and a real number v, there exist a nonnegative functional and a 
nonnegative real function tending to zero, as its argument tends to 0, such 
that, uniformly in v, 

(i) F^{u\Y = v) = F{d{x, Xi) < u\Y = v) = (j){u)f^{x) + o{(j){u)) asu^O, 

(ii) There exists a nondecreasing bounded function tq such that, uniformly in 

^ = ro{u) + o{l), as hiO, 
(f){h) 
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(A3) For any real numbers a and b, 



i)fv{x)g{v)dv < oo, (ii) J e''^^''^ f^{x)g{v)dv < oo, 
(m) / e''^^''^f^{x)g{v)l{v)dv < oo, {iv) [ e"^^"^ U{x)g{v)l^{v)dv < oo. 



Discussions of hypotheses. Condition (Al) is very usual in nonparametric esti- 
mation literature devoted to functional data context. From the fact that Lebesgue 
measure does not exist on infinite dimension space, hypotheses (A2) involve the 
small ball techniques related to the fractal dimension used in this paper. A number 
of examples of the function together with the corresponding decomposition of the 
probability of the small balls are given throughout several works (See, e.g., Ferraty 
and Vieu (2000, 2004, 2006), Ferraty et al (2006), Ezzahrioui et al (2008) and Laib 
and Louani (2010)). A further example is given hereafter to illustrate the condition 
(A2)(i). Hypotheses (A3) are set on to insure the needed properties of finiteness 
and differentiability of the moment generating function of the process Z„ (x) . These 
hypotheses induce the fact that the large deviation principle holds with a good rate 
function, a property that is strongly expected in such results. 

Example 1. Let £ be a separate abstract space equipped with the semi-metric 
defined, for {x,y) e by 



d{x,y) = \ J {x{t)-y{t))dt\. 

Consider two elements h and / in C together with the regression model 

Xi — Yih -\- £il, 

where is a real random variable independent of Yi. Observe now, for any u > 0, 
that we have 

F^{u\Y = -y) = P {d{x, Xi) < u\Yi ^v)^f(^\ J {x{t) - Xi{t))dt\ < u\Yi = . 

Consequently, while assuming 7^ \ J l{t)dt\ < 00, \ J x{t)dt\ < 00 and \ J h{t)dt\ < 
00, it follows that 

FMY-v) ^ p(|/(.W-r./.W-«<«|K.^.) 
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= P 1^1 y {x{t) - vh{t) - Sil{t))dt\ < u 

_ f -u + J x{t)dt - V J h{t)dt u + J x{t)dt - V f h{t)dt\ 

V TW)dt TW)dt ) 

u + J x{t)dt-v Jh{t)dt\ ^f-u + J x{t)dt-v J h{t)dt\ 



/ l{t)dt 



where $ is the distribution function of e,. Taking $ as the A/'(0, 1) distribution 
function and assuming that < J l{t)dt < oo, we obtain, 

r. / 1.^ N ^ ( ^ f I ^it)dt - V J h{t)dt\^\ . 

^'("1^=") = jmn'^[--A Jim ) j'^+'-w)' 

and the condition (A2)(i) is satisfied with = 2u and 

□ 

The first result states a LDP for the process Zn(x). 

Theorem 2.1 Under assumptions (Al)-(A3), Zn{x) satisfies a LDP with the speed 
n(f){h) and a good rate function given by 



rx(Ai, A2) = sup {Xiti + \2t2 - ^'^(ii, ^2)} , 



where 



- [\ti + t2l{v))K'{u)e^''+''^^''^'>''^'''>To{u)du 
Jo 



g{v)dv. 



Remark 2.1 If we suppose that the function Tq is differentiahle, then, integrating 
by parts, we obtain 

$n^i,*2) = j fv{xH{u) (e(*i+*^'(-))^H - 1) g{v)dudv 

which gives a more simpler form of the rate function. 
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Whenever we take the function K as the uniform kernel, we obtain a more exphcit 
rate function. In order to display it, we introduce first some further notations. For 
any x & £ and any t e M, set 

and 

V-\t)^mf{s:V,{s)>t}. 

Moreover, assuming that the derivative of the function tq exists and considering the 
fact that To(0) = and to(1) = 1, we observe, whenever K{u) — l[o,i](ii), that 

<^%h,h) = J (e(*^+*^'(^» - 1) Mx)g{v)dv. (4) 

Corollary 2.1 Assume that the function Tq is differentiahle and that K is the uni- 
form kernel over the interval [0, 1], then, under assumptions (A3)(i)-(iv), we obtain 
the following explicit form of the rate function 

I Ai(logAi - 1) + \2V-' (f^) - Ai \ogje''-''^^y^''^f,{x)g{v)dv 
ra;(Ai,A2)=< + J f^(x)g{u)du if Ai > and vo{x) < X2/X1 < vi{x) (^) 
[ 00 elsewhere, 

where Vo{x) = mitew V^{t) and Vi{x) = suptg^ \4(i). 



Remark 2.2 Whenever I — 1a is the indicator function of a subset A of M., it 
is possible to display a more explicit rate function whenever Tq is differentiable. 
Towards this end, for any B gM. and any t ^W, set 

W^{B) = [ f^{x)g{v)dv and 0) = [ To{u)K{u)e'^^''^du. 
Jb Jo 



It follows then that 

r.(Ai,A2) = (Ai-A2)C 



f 

Jo 



r'o{u) 



W^,(A)exp<'r' 



+ / fv{x)g{v)dv 



A, 



+ W,(^)exp<|C 
6 



W^{A) 
1 / Ai — A2 



K{u 
Kin 



du, 



where A is the complementary set of A and 

C-\t) = M{s : C{s) > t}. 

The following corollary gives the result pertaining to a large deviation principe for 
the regression function estimate at the point x. 

Corollary 2.2 Under hypotheses of Theorem \2.1l the regression function estimate 
rn{x) satisfies a LDP with the speed n(j){h) and the good rate function defined by 

7x(A) = inf{r,(Ai,Ax Ai)}. 

Remark 2.3 // we assume that the function tq is differentiahle and that K is the 
uniform kernel over the interval [0, 1], then we obtain the following explicit form of 
the rate function 

7x(A) = j {l-e^v{V-'{X)m-^)Ux)g{v)dv, (6) 
whenever vq{x) < A < vi{x), and 7x(A) = oo elsewhere. 



Remark 2.4 The first and second derivatives of the function 7^ given in the state- 
ment ^ are 

iA^) = V-\X)eM-^V-\\)} j e''--'^'^''-^ f,{x)g{v)dv 

and 

<W = { v'{v\x)) ' (^^"'(^))') ^^P{-^^."'(^)} / e''^-'^'^^^^^f^{x)g{v)dv 

respectively. When Z denotes the random variable associated to the density function 
fv{x)g{v)/ J fv{x)g{v)dv , it follows that \4(0) = E(Z(Z)). Therefore, assuming that 
E(/(Z)) = 0, by Taylor series expansion we obtain, in the neighborhood of X = 0, 
that 

A2 



7.(A) = ^ ^^p^z)) I f^(^)9iv)M^ + ^(^))- 



7 



In the sequel, we investigate the uniform aspects of large deviation, in the Chernoff 
sense, of the regression function estimate r^(a;). More precisely, we consider the 
asymptotic behavior of the quantity ||f^ — r'||c := sup |r^(x) — r'(a;)|, where C is a 

x&C 

class of elements of £. Towards this end, for any £ > 0, consider the following 
number 

A/'(e, C, d) = mm{n : there exist Ci ■ ■ ■ , c„ in C such that V a; G C 

there exists 1 < k < n such that d{x, c^) < e} 

which measures how full is the class C. Further notations are needed to display the 
uniform large deviation result. From now on, set 

A) = inf{7^(a + r\x)) : a G (-00, -A] U [A, 00)}, (7) 

p(A) = infa;gc A), and Dy to be the set of values of the random variable Yi. 
Moreover consider the conditions 

(A4) (i) sup / \l{v)\fy{x)g{v)dv < 00, 
xec J 

(ii) The condition (A2)(i) is satisfied uniformly in v G Dy, 

(iii) / \K'{u)\To{u)du < 00. 
Jo 

Remark 2.5 In the setting of Remark \2.3[ it is easily seen that 

A) = min{7,(-A + r'(x)), 7,(A + r'(x))}, 

since the function is non-increasing on the left of r\x) and non- decreasing on its 
right. 

The following theorem gives a Chernoff-type large deviation result for the uniform 
deviation of the estimate with respect to rK 

Theorem 2.2 Suppose that the function is uniformly continuous upon C and 
that the kernel K is a Lip schitz function hounded from below by a constant Kq> 
Under hypotheses (Al)-(A4) whenever the condition 

\ f J r logA/'(i/,C,rf) 
' for any yl > U, and lim — — = U (8) 



^exp{An0(/i)} / ' ' n-s>oo n(j){h) 

is satisfied and the function p is continuous, for any A > 0, we have 

lim ^^logP(||fl-r'||c > A) = -p(A). (9) 

n-s>oo n(p[n) 
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The continuity of the rate function p is a needed condition to obtain the result of 
Theorem 12.21 It is then natural to ask the question about the required assumptions 
for this condition to be satisfied. The following propositions give a reply to this 
question. 

Proposition 2.1 Assume that the parametric family of functions {TxiX, fJ')}x(^c is 
equi- continuous and that the function r\x) is hounded. Then, the function p is 
continuous. 

It is difficult to state the conditions under which the family of functions {ra;(A, p)}x^c 
is equi-continuous in the general framework. Hereafter, we limit ourselves to the 
case where the kernel K is uniform over the interval [0, 1] and the function tq is 
differentiable as in the setting of Corollary 12.11 Towards this end, we first introduce 
the following notations. From now on, S stands as the generic notation of the 
complementary of any set 5, d{v) = inf fv{x), D{v) = sup fv{x), Ai = {v : l{v) — l < 

0}, Bi = {v : l{v) + 1 < 0} and Ci = {v : l{v) < 0}. Furthermore, we consider these 
additional assumptions 

(A5) (i) Whenever 5* stands as one of the sets Ai or Bi, we have < d{y)g{v)dv < 
oo and < jgd{v)g{v)dv < oo, 



Proposition 2.2 In the setting of Corollary \2.1\ assume that assumptions (A5) 
are satisfied. Then the family of functions {TxiX, p)}x&c is equi-continuous on its 
finiteness domain. 



Remark 2.6 Whenever the smoothing parameter h and the function are such that 



(ii) For any t, 





e'^'-''^l{v){D{v)lcXv) + d{v)lc,{v))g{v)dv < oo, 



exp{An(j){h)} 



o{nh), for any A > 0, 



(10) 



n(t){h) 
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then the condition ^ takes tha form 



limi/log7V(z/,C,c/) = 0. (11) 

i/->0 

Notice that the condition / fiOj) is satisfied when, for example, we take (f){h) = ah"" 

and h = ( " ) ° with a > 1 and a > 0. The condition / fli]) is very usual in 
defining Vapnik- Chervonenkis classes, see, for instance van der Vaart and Wellner 
(1996). Hereafter, examples of classes fulfilling the condition 07]) are displayed. 



Example 1. {Parametric classes of functions) For a function X in the space 
Lp(]R), consider the parametric class of functions defined by 

C = {Xa{.) = aX{a.) : -oo < Ai < a < A2 < oo and a 7^ 0} 

together with the Lp-distance given, for 1 < p < 00, by 

dp{x,y)= (^j \x{t)-y{t)\Pdt 

assuming that the function X is differentiable with a continuous derivative and that 
the function q{t) = tX'{t) is Lp- integrable, it follows that there exists a positive 
constant Cq such that N{h',C,dp) < Cq/u. Therefore, the condition f lTTj) is satisfied. 




Example 2. {Classes of functions that are Lipschitz in a parameter) Let T be an 
index set and consider d a distance over T. Suppose that C = {xt : t G T} is a class 
of functions defined on M, that are Lipschitz in the index parameter t in the sense 
that there exists a function a; on M such that for any m G M, 

\xs{u) — Xt{u)\ < d{s, t)x{u). 

From Theorem 2.7.11 in van der Vaart & Wellner (1996), it follows, for any norm 
||.|| whenever ||a;|| < 00, that 

Ar{u\\xlC,l\\) < N{iy,T,d), 

where N{i',T, d) is the minimal number of balls of radius v needed to cover T. 
Therefore, the condition (fTT]) may be expressed as 

limz/logiV(z/,T,rf) = 0, 
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which is a Vapnik-Chervonenkis class of sets condition. Naturally, it is more easy 
to display examples of Vapnik-Chervonenkis classes of sets. As an example, let x 
be a Lipschitz boundedly supported function. For an index set T included in M, 
define the class C by taking, for any u G M.,xt{u) = x{u — t). It is obvious then 
that the Xts are Lipschitz with respect to the index parameter t. Taking d as the 
absolute distance on T that we take as a bounded convex interval, it follows easily 
that N{v,T,d) < \T\/v, where |T| is the diameter of T. Therefore, the condition 
f lTTj) is satisfied. 

Example 3. {Smooth function classes) Let W be a bounded convex subset of R'^ 
with nonempty interior. For any a > 0, consider the class of functions on U that 
possess uniformly bounded derivatives up to order [a] , where [a] stands as the integer 
part of a, and whose highest derivatives are Lipschitz of order a — [a]. Denote by 
a;^') the Z-th derivative of x and set, for any x : U ^ M., 



\x\\a '■= maxsup \x^^\u)\ + sup 



Ml 



o 

where U is the interior of U. Let C = C^jQJ) be the class of all continuous functions 
X : W — )■ M with < M. It follows from Corollary 2.7.2 of van der Vaart & 

Wellner (1996) that, for every p > 1 and any i/ > 0, there exists a constant c 
depending only on a, the diameter of U and d such that 

logiV[](z/,Cr(W),Lp) <c' ^ 

Here, A/j ] denotes the bracketing number (see, for instance, van der Vaart & Wellner 
(1996) page 83, for the definition) and, for a probability measure /x, Lp{x,y) = 

{J \x{u) — y{u)\Pdfi{u))p . Since 

it is then clear that the condition flTTj) is satisfied provided that a > 1. 

3. PROOFS 

Proof of Theorem l2.1l The Laplace transform associated to the process n(f){h)Zn{x) 
is defined, for any (^1,^2) ^ by 

<l>^(ti,t2) = E[exp{< {ti,t2),n(j){h){fnA{x),fn,2ix)) >}] 
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E 



,i=l 



i=l 



= iE[exp{{h + hm))A^{x)}]r ■= 

where < ., . > denotes the inner product. Let us now evaluate the quantity <^^(ii, ^2)- 
Observe that 



vlihM) = l + E[exp{(ii + i2i(yi))Ai(x)}-l] 



1 + 
1 + 



d{x, Xi) 
h 



<u,Y <v 



< It I y = i;^ (m{Y < v) 



J (e(*i+*2'MW«) - 1) rf. ^ 
Integrating by parts with respect to the component u, we obtain 

^Utut2) = 1 + 1 [(e(*^+*^'(^))^'(^) - 1) F.(/t|F = ^) 

ih + t2l{v))K'{u)e^''+''^^''^^^^'''^F^{uh\Y = v)du] dF{Y < 
Making use of the condition (A2)(i), we obtain 



- [\h 

Jo 



+ t2l{v))K'{u)e 



{H+t2l{v))K{u) 



{(t){uh)f^{x) + o{(t){uh))du\ d¥{Y < v) 



l + mi [(e(*^-^*^'("))^« - 1) {Mx) + o{l)) 



By the condition (A2)(ii), it follows that 

t2)^ 1 + m (1 [(e(*^+*^^('^))^(^) - 1) iUx) + 0(1)) 



rfP(F < v) 



{ti+t2l{v))K'{u)e 



{ti+t2l{v))K(u) 



{Ux) + o{l)){To{u) + o{l))du\ d¥{Y < v)) . 
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Therefore, after a Taylor series expansion of the function log(l + u) around u = 0, 
we obtain 

hm -l-log<l>^(ti,t2) := <f^(ti,t2)= //.(x)[(e(*^+*^'(^))^«-l) 
n-^oo n(p[h) J 

- f (ti + t2l{v))K\u)e^''+'''^''^^''^''\Q{u)du] g{v)dv 
Jo 

Note that the condition (A3) implies that the function $^(^1,^2) is finite and differ- 
entiable everywhere. The Fenchel-Legendre transform of $^(^1,^2) is given by 

r..(Ai, A2) = sup {Aiti + A2t2 - t2)} . 

We have now to establish that the function $^(^1,^2) is essentially smooth and to 
use the Gartner-Ellis Theorem (see, Dembo & Zeitouni (1998), page 44) to achieve 
the proof. 

Considering hypotheses (A3) (i)-(ii), it is clear that the interior of the set D = 
{(^1,^2) : '^'^(^1,^2) < 00} is not empty. Moreover, making use of conditions (A3), it 

o 

follows that the function $^'(ti,t2) is different iable throughout the domain D- Sub- 
sequently, it is clear that the function $"^(^1,^2) is steep and, therefore, is essentially 
smooth. □ 



Proof of Corollary 12.11 In view of the statement (jlj), we have to maximize the 
function 

Q{ti,t2) = Xih + A2t2 - J (e(*i+*^'(^)) - 1) f,{x)g{v)dv. 

Since the function Q is concave, it is easily seen that its maximum is reached at the 
point 

{h,h)= (^log(Ai)-log J e''-"i^y^''^Mx)giv)dv,V- 

which gives the main form of the rate function given in the statement (|5]). 

In order to display the finiteness domain of the function T^, we have to study 
the function V^. Observe from hypotheses (A3) that is a differentiable function 
and that its derivative is given by 

^ ^ {Je'^(^^Mx)g{v)P{v)dv) {J e'^^^^ Ux)g{v)dv) - {J e'^i^^ Ux)g{v)l{v)dvf 

{Je^'(^)Ux)g{v)dvY 
J Je*('(")+'(''))/„(x)/„(x)^(M)^(t;)(/2(t;) - l{u)l{v))dudv 
{Je^^(-)Mx)giv)dvY 
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Therefore, K is an increasing function. Notice that f i(x) = hm(_j.oo Vx{t) = sup^ Kc(t) 
exists in the closure M of M. 

Assuming now that A2/A1 > vi{x), it results that there exists e > such that, 
for any t G M, 

^ + ^>K(t). (12) 
Integrating in both sides of (fT2|) with respect to t, it follows, for any t G M, that 

^ + t + Co > log y e*'('')/,(x)^?(t;)rft;, 

with Co = log/ fv{x)g{v)dv. Therefore, for any (^1,^2) G M^, we obtain 

/f(ti,t2) := Aiti + A2t2-exp|ti+ (^^ + e^t + Co|+e^° 

< Aiti + A2t2 - j (exp {ti + t2l{v)} - 1) Ux)g{v)dv. 

Thus, 

supi^(ti,t2) < r^(Ai, A2). 

Studying now the function if, it is easily seen that 

00 = supif(ti,t2) < ra;(Ai, A2) 

tl,t2 

whenever A2/A1 > Similarly, whenever A2/A1 < Vq{x) , we obtain 00 = 

r.(Ai,A2). □ 

Proof of Corollary 12.21 The proof follows straightforwardly from Theorem 12. II by 
making use of the contraction principle with the following continuous function 

H : X M ^ M 

(Ai,A2)^^. (13) 

Consequently, satisfies the LDP with the speed n(j){h) and the rate function 

7,(A) := inf{r,(Ai,A2):ii(Ai,A2) = A} = inf{r,(Ai,A2):A2/Ai = A} 
= inf {r^(Ai,Ai X A) : Ai > 0}. 
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□ 

Proof of Theorem 12.21 First of all, since the rate function is continuous, it 
follows by the contraction principle, used with the continuous map y — )■ y — r\x), 
that for any A > 0, 

lim — L-logP(|fi(x) -r'(x)| > A) = -/3(x,A). (14) 
rn-oo n<p\n) 

To state the uniform lower bound, it suffices to notice that for any x G C, we have 

liminf — ^— logP(||f' - r'll > A) > liminf , logPflf' (x) - rHx)\ > A) 
" n(j)[h) n-s>oo n(j)[h) 



n— ^oo 



> -/3(a;,A). 

Therefore, 

liminf log P( II fj^-r' II > A) > -p(A). (15) 
?i-s>oo n(j)[h) 

Towards establishing the upper bound, observe first that 
ll^i~''"'llc = niax sup |f^(x) — r'(x)|, 

< max \riicj) — rHcj)\ + max sup \rUcj) — fUx)\ 
+ max sup \r\cj) — r\x)\, (16) 

l<j<N{u,C,d)^^Ba{cj,u) 

where Bd{cj, u) = {x & £ : d{cj,x) < u}. Assuming that r' is uniformly continuous 
on C, it follows, for any e > 0, that there exists u > such that 

max sup |r'(cj) — r'(x)| < £. 



For any x G C and any c G C, observe that 

Ell m {k (^) - K 



rl(x)-rl(c. ■„ 

d{x,Xi) 
h 



d{x,X,) \ _ ^ ( d{c,Xi) 
h 
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Assuming the kernel to be a Lipschitz function, it follows that 



^ d{x,Xi) \ _ ^ / d{c, Xi] 



h \ h 



M M 
< —\d{x,Xi) - (i(c,Xi)| < —d{x,c), 



where M is a positive constant. Therefore, whenever the kernel K is bounded away 
from below by Kq > 0, we have 



2Mz/ 



Thus, for any £ > 0, by Markov's inequality, we obtain 

P| sup |fi(x)-fUc)|>.| < P^|:|/(F.)|ir(^^) >.-^°^^ 



2Mu 



Proceeding now similarly as in the proof of Theorem I2.H we obtain 

^{\m\K(^^^\\ = m ( f imimiMc) + o{i)) 



\l{v)\K'{u){Mc) + o{l)){To{u) + o{l))du]g{v)dv 

:= mA 

where, by conditions (A4), A is a finite constant. Consequently, there exists a 
positive constant C such that 



( 



P max sup IfUx) - flicAl > e ] < C^(u,C,dU(h) — . 

\i<j<Afi.,c,d) :ceB,ic„.) / '''he 



Considering the decomposition in the statement (jT6|) . it is easily seen that 
P(l|ri-r'||c> A) = f( mjxx \fUcj)-r\c,)\>X-2e) 

\l<j <N{iy,C,d) J 
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1 



v 



P max sup \fn{x) — r^(cj)| > e 
P( max \fl(c^ - r\ci)\ > X - 2e] 

\l<j<Af(i^,C,d) J 



< P( max \fl(ci) - r\ci)\ > X - 2e 



1 + 



cAr{u,c,d)mve 



P( max \fl(ci) - r\c^\ > X - 2e] 
\l<j<^f(.I^,c,d) ■' ' J 

Since, for any -u > 0, log(l + it is obvious then that 



\ 



— ^logP(||fl-r'||c>A)<— ^logPf max \f'^{cj) - r\cj)\> X - 2e\ 
n(j){h) ^" ^ n(j){h) \i<j<Af{u,c,d) J 

CM{v,C,d)v 



nheF ( max |'ri(c,) - r'fc,)! > X - 2e 

\l<j<JV(u,C,d) 



Therefore, from the statement f|T5l) . we obtain 
^ logP(||fi-r'||c>A) 



n(j){h) 



< -^logAr(z/,C,rf) 

n(j)[h) 



+ 



sup — — — logPf max \r''Jx)—rHx)\>X — 2e\ 
xecn(f){h) \i<j<M(u,c,d)' ' J 



+ ^^% xpWW(p(A) + o(1))}. 

Making use of the condition ([8]), it follows that 

limsup— ^logP(||fi-r'||c > A) < -p{X-26). 
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The proof is achieved while making e tend to zero since the function p(A) is contin- 
uous. □ 



Proof of Proposition ETT] Observe first, for any positive real numbers A and Ai, 
that 

p(A) = inf /3(x,A) = inf {/3(a;,A) -/3(x,Ai) +/3(x,Ai)} 
< inf Ai) + sup{/3(a;, A) - Ai)}. 

Therefore, we have 

|p(A)-p(Ai)| <sup|/3(x,A)-/3(x,Ai)|. 
Considering the statement ([7]), we obtain for A < Ai 



|p(A)-p(Ai)| < sup 
< sup 

x&C 



inf 72:(a + r'(x)) — inf '^^{01 + r\x)) 

|q|>A |cf|>Ai 

inf (7^. (a + r\x)) - 7x(A + r\x))) 

\a\>\ 



- inf (7^(a + r'(x)) -7^(A + r'(x))) 

|o|>Ai 

<sup< inf |7^(a + r'(x)) -7^(A + r'(x)))| 
+ inf |7x(a + r'(x)) -7^(A + r'(a;)))| 

|«|>Ai 

< 2 sup |7^(A + r\x)) - 7^(Ai + r\x)))\ . 



Taking into account the shape of the rate function 73, given in Corollary \2.2\ we 
obtain 

|p(A)-p(Ai)| < 2sup infr,(5,5(A + r'(x)))-infr,(5,5(Ai+r'(x))) 



< 2 sup 



inf (r,(5, 5{\ + r\x))) - r,(A, A(Ai + r\x)))) 



- inf (r,(5, 5(Ai + r'(a;))) - r,(A, A(Ai + r\x)))) 

o 

< 2 sup |r,(A, A(A + r\x))) - r,.(A, A(Ai + r\x)))\ 
+2 sup |r,.(Ai, Ai(Ai + r'{x))) - r,(A, A(Ai + r'{x 

x&C 



18 



It suffices now to use the fact that {Tx{\, fi)}xec is a equi-continuous family of 
functions and that the regression function r' is bounded to achieve the proof. □ 

Proof of Proposition 12.21 Observe by the condition (A3)(i)-(iii) that is a 
differentiable function and that 

r^.(A, /i) = + i2tx - <i>^'(sx, ^x), 

where and are solutions of equations 

_ S*^' d<!>' 



1 



{s,t) = X, (ii) —-{s,t) = fi. (17) 



(9s ' ' dt 
respectively. Therefore, for any Ai and /ii, we have 

Tx{\,fi) = AiSj. + /iit^. - + (A - Ai)s^ + (/i - 

< sup{Ais + /iit-<l>^'(s,t)} + |(A- Ai)s^| + 

s,t 

< r^(Al,yUl) + |(A - Al)s^.| + |(yU - ni)t^\ 

and then 

|r^(A,/i) - r^(Ai,/ii)| < |A - Aills^l + l/i - 
We have now to state that both sup \tx\ and sup \tx\ are finite. 
Observe from the statement f|T71) (i). whenever > 0, that 



A = e^M / e'-+'-^^^''^-^^ f,{x)g{v)dv + e'^^'^^^^"'^-^^ f,{x)g{v)dv 
\Ja, JAi 

> e'-+*- [ e'^^^^"'^-^^ f^{x)g{v)dv > e'^^'^ [ d{v)g{v)dv. 



JAi 

Therefore, we have 

Sx + tx < log 

Whenever tx < 0, similarly, we obtain 

Sx + tx < loe 



Ia, d{v)g{v)dv 



A 



Iai d{v)g{v)dv ^ 

Therefore, whatever the value that may take t^, we obtain 
Sx + tx< max I log I -J. — , , , I , log 



!ai d{v)giv)dv J ' yj^^ d{v)g{v)dv ^ 
19 



On another hand, whenever t^^ > 0, we have 

A = e'- ( [ e-'-+'-'^'^'"'>+'^ f,{x)giv)dv + I e-'^+''^^"^'"^+^'> f,{x)g{v)dv 



\JBi JBi 

> e'^-'^ [ e'^^^^''^^^^ f^{x)g{v)dv > e'^-'^ [ d{v)g{v)dv. 

Jbi Jbi 

Consequently, we have 

A 



Sx-tx < log 

Whenever tx < 0, similarly, we obtain 

Sx - < loe 



Ibi d{v)g{v)dv j ' 



A 



!bi d{y)g{v)dv ^ 
Therefore, for any value that may take t^., we obtain 

Sx-tx< max \ log I ^ . X , 1 , log I . w 1 • 

y \iBidiy)g{v)dv j yj^^d{v)g{v)dv 

Considering the statements (fT8|) and (fT9l) . it follows that 
Sx < ^ max \ log I -J — ,, , , , 1 , log ^ 



2 \ \lAtd{v)g{v)dv J ' yf^^d{v)g{v)dv^ 

Taking into consideration the definition of the function Vx given in the statement 
(j3]), it is clear, for any t G M, that 

Je^Kv)D{v)giv)dv " 

Consequently, considering the inverses of the functions Vd and Vx together with 
equations of the statement ( fT7|) . since is a nondecreasing function, it follows, 

whenever ^ > ^o,d := inf V^(t), that 
A * 

h := V,' (£l := inf : Vd{s) > ^} > inf : Vx{s) > j} = tx- (21) 
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Observe now, for any t G R, that we have 

_ J e'^(^niv)idiv)lc,iv) + D{v)lcX^))g{v)dv 
^^^^^ J^m{v)Mdv ^ ^' 

Similarly as above, whenever ^ < Vi^d := supVD(t), we have 

to := V^' (£j := inf [s : Vd{s) > ^} < inf {s : Vx{s) > ^} = t,. (22) 
Moreover, it is obvious from the statement (fT7|) (i) that 

e'°^^''^D{v)g{v)dv+ [ e''^^''^ D{v))g{v)dv] > A. 
Ci Jci J 

Therefore, for any A > 0, we have 

- (/^^ e'oi{v)C)(^y)g^y)dv + /^^ e*i'('')D(t;))(7(t;)c/t;) ^^^^ 

Consequently, making use of the statements (!20!) . (pT]) . fl22l) and (!23|) . it is clear that 
there exist finite numbers 5*0 and Tq such that 

sup |r^(A,/i) - r^(Ai,/ii)| < |A - Aill^ol + l/i - /xi||To|. 

This establishes that the family of functions {r^(A, /i)}^gc is a equi-continuous and 
achieves the proof. □ 
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